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Question 5 


Intent of Question 


The primary goals of this statistical inference question are to assess a student’s ability to: (1) distinguish an 
observational study from an experiment; (2) state the appropriate hypotheses for a research problem; 

(3) check the appropriate conditions for an inference procedure; and (4) interpret standard results for an inference 
procedure that is unfamiliar to students. 


Solution 
Part (a): 


This is an experiment because the researchers imposed treatments by randomly assigning drivers to the two 
different conditions (simulated driving while talking on a cell phone versus simulated driving while talking to 
a passenger). 


Part (b): 


Let p.., denote the proportion of drivers who miss an exit while using a cell phone and p,,4;; denote the 
proportion of drivers who miss an exit while talking to a passenger. 


Ho: Pcell = Poass 
Ay: Pcell > Ppass 


Part (c): 


The conditions required for a two-sample z-test of equal proportions are: 
(1) independent random samples or random assignment, and 


(2) large sample sizes| 1, D, >10,n,(1— p,) =10,n, p, =10,n,(1— p,) = 10 
Random assignment is stated in the stem so the first condition is met. However, the numbers of successes 


(Noo Peon = 7 andn = 2) are both smaller than 10, so the large sample condition is not met in this 


pass Pp pass 


situation. Note: If the student uses the rule of thumb with 10 replaced by 5, then the number of successes for 
the second sample is still too small. 


Part (d): 


Interpretation: Assuming that talking on a cell phone and talking to a passenger are equally distracting (there 
is no difference in the two population proportions of drivers who will miss the exit), the p-value measures the 
chance of observing a difference in the two sample proportions as large as or larger than the one observed. 


Conclusion: Since the p-value 0.0683 is larger than 0.05, we cannot reject the null hypothesis. That is, we do 
not have statistically significant evidence to conclude that using a cell phone is more distracting to drivers 
than talking to another passenger in the car. 


Notice that if we increase the significance level to 0.1, then we could reject the null hypothesis and conclude 


that drivers are significantly more distracted when using a cell phone. 
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Question 5 (continued) 


Scoring 


Parts (a) and (b) are scored as essentially correct (E) or incorrect (I). Parts (c) and (d) are scored as essentially 
correct (E), partially correct (P), or incorrect (I). 


Part (a) is scored as essentially correct (E) if the student indicates that this is an experiment because treatments 
were imposed. 


Part (a) is scored as incorrect (I) if no explanation is provided, or the student says that this is an observational 
study. 


Part (b) is scored as essentially correct (E) if the student correctly identifies the two population proportions with 
the correct hypotheses. Nonstandard notation must indicate reference to population proportions. 


Part (b) is scored as incorrect (I) if the student is clearly referring to the sample proportions. 


Part (c) is scored as essentially correct (E) if the student provides both conditions and correctly comments on 
both. 


Part (c) is scored as partially correct (P) if the student provides and correctly comments on only one of the 
conditions. 


Part (c) is scored as incorrect (I) if conditions are provided but no correct comments are given. 


Part (d) is scored as essentially correct (E) if the p-value is correctly interpreted AND the correct conclusion is 
provided AND context is given. 


Part (d) is scored as partially correct (P) if: 


i) either the p-value is correctly interpreted OR the correct conclusion is provided 
AND 
ii) context is given. 


Part (d) is scored as incorrect (I) if neither a correct interpretation of the p-value in context NOR a correct 
conclusion in context is provided. 


In part (d) if both an @ and a p-value are given together, the linkage between the p-value and the conclusion is 
implied. If no @ is given, the solution must be explicit about the linkage by giving a correct interpretation of the p- 
value or explaining how the conclusion follows from the p-value. 


Note: Any choice of an @ could have been made as long as the appropriate interpretation is made relative to that 
choice of@ . 
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Question 5 (continued) 


Each essentially correct (E) response counts as 1 point; each partially correct (P) response counts as 2 point. 


4 Complete Response 
3 Substantial Response 
2 Developing Response 
1 Minimal Response 


If a response is between two scores (for example, 2! points), use a holistic approach to determine whether 
to score up or down depending on the strength of the response and communication. 
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5Al 


5. Researchers want to determine whether drivers are significantly more distracted while driving when using a 
cell phone than when talking to a passenger in the car. In a study involving 48 people, 24 people were randomly 
assigned to drive in a driving simulator while using a cell phone. The remaining 24 were assigned to drive in 
the driving simulator while talking to a passenger in the simulator. Part of the driving simulation for both groups 
involved asking drivers to exit the freeway at a particular exit. In the study, 7 of the 24 cell phone users missed 
the exit, while 2 of the 24 talking to a passenger missed the exit. 


(a) Would this study be classified as an experiment or an observational study? Provide an explanation to support 
your answer. 


Thas Uoould be Considered on expeviment because treatments 


Wei e imeosed, alking On acell phone, and jalking to a 


x AES 


(b) State the null and alternative hypotheses of interest to the researchers. 
ee P, = proportion of drivers whe missed fra exit While 
talting on a celiphane 
Py pee 
PHPTON of drivers awNe missed the exit 
While Fa\ting I Q passeng 


il 


He. pe 
Vi = Pz 
Har Pi > Pez 


GO ON TO THE NEXT PAGE. 
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5A2 


(c) One test of significance that you might consider using to answer the researchers’ question is a two-sample 
z-test. State the conditions required for this test to be appropriate. Then comment on whether each condition 
is met. 


Yr To Use a 2-samepk 2-kst the 2 Samous must be 
2 independend SPS, T must be Known, and the distribution 
MuUSk be normed. 
Q) ry yas stated tak the 2 Samples were Tandomly assigned, bak rt dia 
Wer Say Geto gourd pants Were Renae Selected. WAX 
@ th & O values of each Sample ave Unknown, kK 
(3) Pov a normal distribution, N, 625, 12625, n.OP)25 120-Ps 


24 (0.0718) = 0187S ZS, 24 (1-0-0078) = 23.8125 pe ACerS) Gh eIs Fe. 
2 4 (1-0-0078) =23.812>5 — because thay are not alimet, the Ars H7 bution 


| Shot novmat. 
Not all 3S canditions are met, Werefore o 2-Sample 2 kes 


; + 

7 iS Mot An appropriate test of signiftcanes 
(d) Using an advanced statistical method for small samples to test the hypotheses in part (b), the researchefs . 
report a p-value of 0.0683. Interpret, in everyday language, what this p-value measures in the context 


of this study and state what conclusion should be made based on this p-value. 


The p-value calculates the prbabilvty that a more extremg 


Volume voi \\ OCcCUre , OSG Vag null hy pothesis iS trrte 
In this case, i we weve 


| Testing art a 10% level, the pValue 
'S Smaller than O10 and 


to sony people Fa teing jim We 
Anose Talting to passengers. 
How ever, if we were testins ak the SH levei, the p-Vaine 


We would have Sig nificant evidence 


phone were more Ostracted than 


 Aveokw than 0.05 and we would net be abu to ay 


With COL Sig nit Gant evidines. thet flure iS A ol F ference 


¢ © } | Ow 


GO ON TO THE NEXT PAGE. 
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SB 


5. Researchers want to determine whether drivers are significantly more distracted while driving when using a 
cell phone than when talking to a passenger in the car. In a study involving 48 people, 24 people were randomly 
assigned to drive in a driving simulator while using a cell phone. The remaining 24 were assigned to drive in 
the driving simulator while talking to a passenger in the simulator. Part of the driving simulation for both groups 
involved asking drivers to exit the freeway at a particular exit. In the study, 7 of the 24 cell phone users missed 
the exit, while 2 of the 24 talking to a passenger missed the exit. 


(a) Would this study be classified as an experiment or an observational study? Provide an explanation to support 
your answer. 


Thy Stu a ve classified as an 

eX PR anni UG SC..G TECOT IG © 
bting ymposed oh the SUbjECTS. SuUla)* CIS 
ARE purintoa a cikiving simuUl\aToR one 
earn if GIN a cell Priche To Talk cn ane 
rhe orhee gers a passenger TO talisTo, 

If MS weee an ovbseevatcnal tUCY, 


the envVikunment wiciat cl pot Pe 
Mam Pulored. m 


(b) State the null and alternative hypotheses of interest to the researchers. 


NUIle ThE proportion of daivers who missed 
THe exit Wnilé talsing on the phnene 
and tartng TO A paKergte are the 
SQW ( Ha . P, =). 

a\iteeviative: The peapoRticn of Cleivers who 
missect the CxiT WIL TailKiing 
ow the prove 1S .gpearee thn 
The peo Pcetion whoa missect the 
~ exit WWATLe raking TO A Passenger 
(tg: P>P.) 


* P= PROPORTION OF ChaVeRo VUNG wisse Cl 7 he 
exif wile on tre PCN | 
cw OF CleIVOS VAIG Li isseol tthe 


R,- PROPS 24 
exiy WWI TOK) +O a POS EPO eR 


GO ON TO THE NEXT PAGE. 
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SB2 


(c) One test of significance that you might consider using to answer the researchers’ question is a two-sample 
z-test. State the conditions required for this test to be appropriate. Then comment on whether each condition 


o SAMpIeS aze iInclependent of cach arpere 
~ aitfeeert people ee Used iM TRECTTMenh 
QeouPs, So chance they WAN wuss Te €xIt 

is Indeeendern- | 


Sampres ARC Simple Random sampler 
—~SiIatea IN pRololemm +*mrar pecpie yere 
RaNcamy assignee 


APs, Ha MP2, N2(1- Pz) Ave AIL AS 
-(24)(ga)=F>S  ~(24)(24)= 2 ZS-2.. AIS conch tion 15 
: ve 
~UVA(EDIFAS — -(2A 35222985 TERYSE PSE 


(d) Using an advanced statistical method for small samples to test the hypotheses in part (b), the researchers 
report a p-value of 0.0683. Interpret, in everyday language, what this p-value measures in the context 
of this study and state what conclusion should be made based on this p-value., 


Thee 1S a peobabiity of .coes Thar 
#/74 cellpnune Usees and 2/24 passenger 
FO\KLeS il wuss *heikR exit ow even mere 
EXTRRLMEL PREPCRTIONG WII occuUk. At of=.0F, 
theekipiencugn evidence +a peject the 
VU Wy Perhesis. THe DECRLRTCh of oleivers 
RE a eee the ad Wile +alsing ci) 
OQ Ce\UP OANA rAleK ING toa OL 

\S me SANE, Howevee eh Perna 
evese® Ww Ne CONCLUSION WECAUSE ono ; 
ACKUMPHIEN S NOTA. 


GO ON TO THE NEXT PAGE. 
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Sa 


5. Researchers want to determine whether drivers are significantly more distracted while driving when using a 
cell phone than when talking to a passenger in the car. In a study involving 48 people, 24 people were randomly 
assigned to drive in a driving simulator while using a ceil phone. The remaining 24 were assigned to drive in 
the driving simulator while talking to a passenger in the simulator. Part of the driving simulation for both groups 
involved asking drivers to exit the freeway at a particular exit. In the study, 7 of the 24 cell phone users missed 
the exit, while 2 of the 24 talking to a passenger missed the exit. 


(a) Would this study be classified as an experiment or an observational study? Provide an explanation to support 
your answer. 


This shady all be Neate OS An ds stato! 
Study. The f- 


ec em Control y ae a present so i+ 
Was not 


aN 0 peciment 


(b) State the null and alternative hypotheses of interest to the researchers. 


Ho f- of missing ant on phono = Pr of missing Pre: tal kerag 
| “to passange F 


raissing Ox. } ta Vem 


Ha P of mig eit on phone 7 ¢ of 
fo passengel 


r= probably 


GO ON TO THE NEXT PAGE. 
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oi Gre 


(c) One test of significance that you might consider using to answer the researchers’ question is a two-sample 
z-test. State the conditions required for this test to be appropriate. Then comment on whether each condition ~ 
is met. 


ack same te Le > & Fis not for the gf om p 


te ieing +o dhe passenger, Also, sarnpl Sites must 
he lege, > 90, ths wes nod met fr either. 


(d) Using an advanced statistical method for small samples to test the hypotheses in part (b), the researchers 
report a p-value of 0.0683. Interpret, in everyday language, what this p-value measures in the context 
of this study and state what conclusion should be made based on this p-value. 


In the conlert of th  shuly, this p-vale measurt: 
the pr obsbility thet “yud grag. Cae data, drivers 
ba Ae - eas cormples are equally Ike by to mss the 
ent. Because the p value is 2 small, babod 77, 
it shoul be Babes thet de deivers Ore 
more hike ly bo mass te eye ile Falling 0 the 
phore then uh. fo fallting = te « passeng OO 


GO ON TO THE NEXT PAGE. 
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Question 5 
Overview 


The primary goals of this statistical inference question were to assess a student’s ability to: (1) distinguish an 
observational study from an experiment; (2) state the appropriate hypotheses for a research problem; (3) check the 
appropriate conditions for an inference procedure; and (4) interpret standard results for an inference procedure 
that is unfamiliar to students. 


Sample: 5A 
Score: 4 


Each part of this response is complete, concise, and clearly communicated. In part (a) the response clearly and 
correctly classifies the study as an experiment and explains that treatments were imposed. In part (b) the response 
correctly states the null and alternative hypotheses and gives standard notation for the null and alternative 
hypotheses for the two-sample test of proportions. In part (c) the response correctly lists conditions (random 
assignment and the numerical checks for approximate normality) and correctly comments on each of the 
conditions. The response uses the pooled proportions estimate to conduct the numerical checks for approximate 
normality. In part (d) the response gives a correct interpretation of the p-value and correctly interprets the 
conclusion in context. This is a complete response. 


Sample: 5B 
Score: 3 


Three of the four parts are complete and clearly communicated. In part (a) the response clearly and correctly 
classifies the study as an experiment and gives as an explanation that treatments were imposed and that the 
subjects were randomly allocated into two groups. In part (b) the response correctly states the null and alternative 
hypotheses for the two-sample test of proportions using standard notation. The response distinguishes and defines 
the two population proportions. In part (c) the response correctly lists conditions (random allocation and the 
numerical checks for approximate normality) and correctly comments on each of the conditions. In part (d) the 
response gives an incorrect interpretation of the p-value and incorrectly gives the conclusion as a definitive 
statement on the equality of the two proportions, in effect accepting the null hypothesis. This is a substantial 
response. 


Sample: 5C 
Score: 2 


One of the four parts of this response is complete and clearly communicated, and two parts are partially correct. In 
part (a) the response incorrectly classifies the study as an observational study and gives as an explanation that 
there was no control. This is an incorrect response for part (a). In part (b) the response correctly states the null and 
alternative hypotheses for the two-sample test of proportions using standard notation. The response also 
distinguishes the two population proportions by defining them. In part (c) the response correctly lists and checks 
the sample-size requirements for approximate normality but fails to recognize the necessity of random assignment. 
This is a partially correct response for part (c). In part (d) the response gives an incorrect interpretation for the p- 
value but a correct conclusion based on the observed p-value. Overall, this is a developing response. 
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